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Abstract 


Entropy is a key measure in studies related to information theory and its many applications. 
Campbell of the first time recognized that exponential of Shannon’s entropy is just the size 
of the sample space when the distribution is uniform. In this paper, we introduce a quantity 
which is called exponential Tsallis-Havrda-Charvat entropy and discuss its some properties. 
Further, we gave the application of exponential Tsallis-Havrda-Charvat entropy in quantum 
information theory which is called exponential quantum Tsallis-Havrda-Charvat entropy with 
its some major properties such as non-negative, concavity and continuity. It is found that 
projective measurement will not decrease the quantum entropy of a quantum state and at the 
end of the paper gave an upper bound on the quantum exponential entropy in terms of ensembles 
of pure state. 
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1. Introduction 



be a set of discrete finite n-ary probability distributions. Havrda and Charvat [4] defined an 
entropy of degree a as 



( 1 ) 


where a is a real positive parameter not equal to one. Independently Tsallis [14], proposed a 
one parameter generalization of the Shannon entropy as 



( 2 ) 
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where a is a real positive parameter and a 7 ^ 1. Both these entropies essentially have the same 
expression except the normalized factor. The Havrda and Charvat entropy is normalized to 
1. That is, if 7 I = (l> l) > then *H°‘{A) = 1, where as the Tsallis entropy is not normalized. 
Both the entropies yield the same resuit and we called these entropies as the Tsallis-Havrda- 
Charvat entropy. Since lim H°‘{A) = H{A), the Tsallis-Havrda-Charvat entropy H°‘{A) is a 
single parameter generalization of the Shannon entropy H{A), where 


E TX 

ai log ai. (3) 

When a = 2, the Tsallis-Havrda-Charvat entropy becomes the Gini-Simpson index of diversity, 




(4) 


Tsallis-Havrda-Charvat entropy was studied as the entropy of degree a for the first time by 
Havrda and Charvat [4] and then by Daroczy [3]. This entropy become often used in statis- 
tical physics after the seminal work of Tsallis [14]. Various generalized entropies have been 
introduced in the literature, taking the Shannon entropy as basic and have found applications 
in various disciplines such as economics, statistics, information Processing and computing etc. 
Generalizations of Shannon’s entropy started with Renyi’s entropy [12] of order- a, given by 


= 


1 — a 


log 


E' 


, a ^ 1 , a > 0 


Campbell [2] studied exponentials of the Shannon’s and Renyi’s entropies, given by 

E{A) = 


(5) 

( 6 ) 


and 

= (7) 

where H{A) and Ha{A) represent respectively the Shannon’s and Renyi’s entropies. It may also 
be mentioned that Koski and Persson [ 8 ] studied 

( 8 ) 


exponential of Kapur’s entropy [7] given by 


n 


H(a,l3) (^) 


(/3-a) 


log 


E _o; 

a-i 

i=l 

V' /3 

E a-i 


a ^ P,a^ P > Q 


(9) 


i = l 

It is interesting to notice that, in the case of discrete uniform distribution A £ A„ , ( 6 ),(7), and 
( 8 ) ali reduce to n, just the ‘size of the sample space of the distribution’. 

This paper is organized as follows: Sec. II, define the exponential Tsallis-Havrda-Charvat 
entropy and discuss its some major properties corresponding to Tsallis-Havrda-Charvat entropy. 
Sec. HI, define exponential quantum Tsallis entropy and some important properties such as non- 
negative, continuity, concavity are proved but different from Von Neumann entropy. Sec. IV, 
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it is found that the projective measurement will not decrease the exponential quantum entropy 
of a quantum state and gave an upper bound on the exponential quantum Tsallis entropy in 
terms of ensembles of pure state. 

In the next section, we study some properties of the exponential ‘type a ’ entropy. 

2. Exponential ‘Type a’ Entropy and Its Properties 

Corresponding to Tsallis-Havrda-Charvat ‘type a’ entropy, the exponential ‘type a’ entropy is 
defined as follows: 

Definition: Exponential ‘type a’ entropy of a discrete distribution A is given by: 

E“(A) =-^^-, a > 0 (/ 1). (10) 

a — i 

When a —>■ 1, measure (10) reduces to Shannon’s entropy. The quantity (10) is entropy. Such 
a name will be justified, if it shares some major properties with Shannon’s and other entropies 
in the literature. We study some such properties in the following theorem. 

Theorem 2.1: The measure of information E“(A), A = (ai,a 2 ,..., a„) € A„, where A„ = 
{(« 1 . 02 ,..., a-n) ■ «i > 0 , = 1 } has the following properties: 

1. Symmetry: i?“(A)= i?“(ai,a 2 ,..., a„) is a symmetric function of (« 1 . 02 ,..., a„). 

2. Non-negative: E°‘{A) > 0, for all a > 0(y^ 1). 

3. Expansible: 

E“(ai,a 2 ,..., a„; 0 ) = E“(ai,a 2 ,..., a„). 

4. Decisive: 

E“(0,1) = £'“(1,0) = 0. 

5. Maximality: 

£“(« 1 , 02 ,..., ffln) < £“(l/n, 1 /n,..., 1 /n) = ^ ^ ^ j^l - e^" . 

6 . Concavity: The measure E°'{A) is a concave function of the probability distribution 
A=(ai,a 2 ,..., a„),ai > 0 , «i = li for all a > 0 (/ 1 ). 

7. Continuity: £“(« 1 , 02 ,..., a„) is continuous in the region «i > 0 for all a > 0. 

Proof: (1),(3),(4) and (5): these properties are obvious and can be and verified easily. We 
know that ^LEi=iPi ]-i _ 1 ;§ continuous in the region «i > 0 for all a > 0. Hence, E°‘{A), is 
also continuous in the region «i > 0 for all a > 0 . 

Property 2: The measure E°‘{A) is non-negative for all a > 0 ( 7 ^ 1). 

Proof: We consider the following cases: 

Case (i): When a > 1, 

^ 1^1 - > 0 , 
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and a — 1 > 0, we get 


Case (ii): When 0 < a < 1, 


E°‘{A) > 0. 



( 11 ) 


and a — 1 < 0, we get 


E°‘{A) > 0. 


( 12 ) 


From (11) and (12), we conclnde that E°‘{P) > 0 for all a > 0. 

To prove the next property, we shall use the following definition of a concave fnnction. 
Definition 4 (Concave Function): A fnnction /(.) over the points in a convex set R is 
concave if for all ri ,r 2 G R and /i G (0,1), then 


m/(»'i) + (1-m)/( 7'2) < /(lt»'i +{l- ^J)r2) (13) 


The function /(.) is convex if the above ineqnality holds with > in place of < . 

Property 6 : The measure E°‘{A) for all a > 0 ( 5 ^ 1) is a concave function of the probability 
distribution A = (ai,a„), Ui > 0, «i = 1 • 

Proof: Associated with the random variable X — (ri, X 2 , •••, Xn) , let ns consider r distribntions 


Ak{X) = {ak{xi),ak{x2), ■■■,ak{xn)} , 


where 

E TT. 

^ Okixi) = 1, fc = 1,2, 

^=l 

Next let there be r nnmbers (Ai, A 2 ,Ar) such that Afc > 0, Afc = 1 and define 


Ao{X) = {ao(a;i), 00 ( 0 : 2 ),..., ao(a:„)} , 


where 

E E 

\kPk{xi ), i = 1,2, 

k=l 

Obvionsly ®o(a:i) = 1, and thus Ao{X) is a bonafide distribution of X. 

If a > 1, then we have 

V" XkE^^iAk)- E^^iAo) 

< ^k = l 

i.e., 

^^^^A,F“(A0< F“(A) (14) 

Similarly for 0 < a < 1, (14) also holds. 


1 _ e(Er=i >iPi)“-i 
a — 1 

1 _ 

a — 1 
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In the next section, we will give the applications of exponential Tsallis entropy in quantum 
information theory. 

3. Exponential Qnantum Entropy and its Properies 

The Von Neumann entropy is the quantum version of Shannon entropy. Von Neumann defined 
the entropy of a quantum state p by the formula 


S{p) = -tr[{p)log{p)] , 


(15) 


where p is any density operator, i.e., positive operator on a complex separable Hilbert space H 
having a unit trace. The exponential Tsallis-Havrda-Charvat entropy also have their quantum 
version, we called it exponential quantum Tsallis-Havrda-Charvat entropy and is defined as: 

^ !)• ( 16 ) 

Using the spectral decomposition theorem and noting tr{UpU^) = tr{p), where U is unitary, we 
can easily verify that 

limE“(p) = S(p) (17) 

Ct —>^1 

The quantity (16) is exponential quantum entropy such a name will be justified, if it shares some 
majors properties with the other’s properties in the literature such as non-negativity, concavity, 
continuity etc. 

Now we will present some properties in the following proposition. 

Proposition 1: The exponential quantum entropy is non-negative, i.e., Ea{p) > 0, where p is 
any density operator. Then Ea{p) = 0, if and only if the state is pure. 

Proof: The Von Neumann entropy S{p) > 0, [Ref. 9 &15]. Now we prove Ea{p) > 0. One 
has a;“ < (resp. > 0)x for x G [0,1] with equality iff x=0 or x=l when a > l(resp.O < a < 1). 
Since the eigenvalues Pj of p lie in [0, 1], we conclude the operator inequality p“ < 1( resp. > )p, 
where equality holds iff p is pure, that is, a one-dimensional projection. It then follows that 
gii-lp )-i < {resp.) > 1 with equality iff p is pure. Noting the sign of in different cases, we 
complete the proof. 

Proposition 2: In a finite dimension n,E°‘{p) is bounded, i.e.. 


E^{p) < 


log {rank p) 


1 

a — l 


1 — e 


(^rankp) 


;ifa=l 

'^] \if OL> 0(7^ 1) 


(18) 


Equality holds in the inequality if and only if p is an equidistribution of order rank (p). 
Proof: To prove the upper bounds of (18), we use Holder’s inequality. For 0 < a < 1, 

E rank n —..rank n 1 \ ^ /v —.rank p 1 \ , 

^ (P“)") (E,., 1^) = (rankp)^-, 

This implies , 

where Pj is the eigenvalues of p. 


( 19 ) 
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Equality holds iff pj is constants for j = 1, 2, rank (p), i.e., Pj = {rank (p)) 

We have the resuit as follows: 

E^ip) < —[l - , a > 0(/ 1). (20) 

1 — Q L J 

Which is the second inequality in (18). For a > 1, the inequality in (19) is reversed but the 
conditions for equality are the same. 

For a = 1, Von Neumann entropy is at most log (rankp). This completes the proof. 

Concavity is another important property. E°‘{p) similar to the Von Neumann entropy. To prove 
the concavity property we have the following lemma. 

Lemma 1: Let Ga(p) ~ tr(p°‘) , a > 1), then 

1. Ga(p) is a concave function of the density operator p for 0 < a < 1. 

2. Ga{p) is a convex function of the density operator p for a > 1. 

Proof: We apply Minkowski’s inequality to positive operators: Let p, cr be positive operators, 
and 1 < a < oo, then 

\tr (p + (j)“] ° < [tr (p)“] “ + [tr (cr)“] “ . (21) 

The inequality (21) is reversed if 0 < a < 1 
Case 1: When 0 < o < 1, from (21), we have 


\tr (Ap + po-)“] > 


A[tr(p)“]“ +p[tr(a)“]» 


( 22 ) 


If 0 < a < 1, the function p = a;“ is concave. This gives 


A[tr(p)“] 


+ P [tr ( 0 -)“] 


> A[tr(p)“]+p[fr((j)“] . 


(23) 


From (22) and (23), we get 

tr (Xp +p,o)°‘ >\[tr{p)°‘]+p[tr(a)°‘]. (24) 


Where A,p>0,A + p= l.Therefore Ga{p) is a concave function for 0 < a < 1. 

Case 2: When o > 1, the inequalities in (24) is reversed, 

tr (Ap + pa)’^ < A [tr (p)“] + p [tr (cr)“] (25) 
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Where X,fi>0,X + fi — 1. Therefore Ga{p) is a convex function for a > 1. 

Concavity of E°‘{p) follows from Lemma 1 and the sign of ^ 7 ^- 
Propositiori 3: Suppose p and cr are density operators and 0 < A < 1. Then 
i?“(Ap+ (1 — A)ct) > XE°‘{p) + (1 — X)E°‘{a) for ali a satisfying a > 0(/ 1). 

Remark: For a = 1, the Von Neumann entropy is a concave function. 

4. Projective Measurement and Quantum Exponential Entropy 

In this section, it is shown that projective measurement will not decrease the exponential quan¬ 
tum Tsallis-Havrda-Charvat entropy of a quantum state, either. And we give an upper bound 
on the exponential quantum entropy (16) in terms of ensembles of pure States. How does the 
exponential entropy of a quantum System behave when we perform a measurement on that Sys¬ 
tem? Not surprisingly, the answer to this question depends on the type of measurement which 
we perform. Nevertheless, there are some surprisingly general assertions we can make about 
how the entropy behaves. 

Suppose for example, than an orthogonal measurement described by projectors Pi is performed 
on a quantum System but we never learn the resuit of the measurement. If the state of the 
System before the measurement was p, then the state after is given by 

P' = Y1" P^PP^- (26) 

The following theorem shows that the exponential entropy is never decreased in this case and 
remains the same only when the state is not changed by the measurement. 

Theorem 4.1:( Projective measurements will not decrease the Exponential entropy): 
Suppose Pi is complete set of orthogonal projectors and p is a density operator. Then the 
entropy of the state p' = Pi p Pi of the System after measurement is at least as greater as 

the original exponential entropy, 

Eo,{p)>E‘^{P), (27) 

with the equality iff p = p', where E°‘{p) represent the quantum exponential entropy of ‘type 
a’ and it is defined as in (16). 

Proof: Spectral decomposition of state p can be expressed as 

p — 'S^ P(a)|a><a| (28) 

Where P{a) £ [0,1], ~ {l® represents a complete orthogonal base. Based 

on this, we can express state p as 

P = n(^)=E, [E. > < “i] ■ (29) 

Writing Pi = ji > < ij with < i\i >= Sar , we have ({ji >} represents a complete orthogonal 
base) 

n(|a >< aj) = Eil < “I* > 1^1* >< *l • (30) 
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Thus we find 


(pt =[n(^)]“=Ej 

^^P(a)| < a|i > l^j |i><i|. 

(31) 

which can lead to 



[(p')“] = Ei 

[E„'P(“)I < “1* > 1^] • 

(32) 

Here, we can note [6] that 




I < a|i > 1^ = I < a|i > 1^ = 1. (33) 

Since a > 1, in that case we can note that function /(*) = x°‘{x > 0) is convex. 

So, 

/ \Yi ^i/(ai). 

where Ai G (0,1) and JDi Ai = 1. From this, (30) and (31), it follows 

^d(p')“l = Ei [E.-P(«)I<«I*>I1“- 
<EJJ^(«)]“Eil<«l*>r 
= EJJ^(«)]“ 

^ ^^[(p')] < E• 

After simplification of (35), we get 

Ec.{p)>E^{P), 


(34) 


which means, that projective measurement can only increase the exponential entropy of the 
state for a > 1 .Similarly for the case 0 < a < 1 , but the inequality in (35) is reversed. 

Now we obtain a relation between the exponential entropy and quantum exponential entropy. 
Theorem 4.2: Let {pi\'4)i >}, where < i/>i|i/>i >= 1 and = 1 , be an ensemble of pure 

States that gives rise to the density operator p, i.e.. 


p=y'.PiiV’i x-ipii- 
‘ ^ % 


(36) 


For a > 1, there holds 


E°‘{p) < E°‘{P). 


(37) 


Proof: Let \j and |())j > denote eigenvalues and eigen States of p = EjE'l<)’t 4>3 \ ■ 
ensemble classification theorem say that [5] 

y/pi\^i > = Y > (38) 

for some unitary matrix [[uij]] . It follows from (38) and < <j>j\4>k >= Sjk that pi = Wij\j , 
where Wij = u*jUij are elements of a unistochastic matrix, i.e., = 1 for ali j and 



Sj ~ 1 i. The function f{x) = x°‘ (x > 0) is convex for a > 1. Applying Jensen’s 

inequality to this function, we obtain 

Ei p? = Ei [E,. «'T A.] < = E,. > 

in view of uni-stochasticity of the matrix [[wij]] . 

E,p“<E/“- (39) 

Since the factor > 0 for a > 1 and we get, 



Due to A“ = tr{p°‘) and the definition (16), the inequality (40) provides (31). 

The statement of the Theorem 4.2 gives an upper bound on the exponential quantum Tsallis- 
Havrda-Charvat entropy in terms of ensembles of pure state. So the scope of the inequality (31) 
is much wider for the parameter a. 
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